In this brief post we talk about why derivatives are so important in machine learning / deep learning, and begin our discussion of them by using pictures and interactive widgets (and very little math).

The widget below shows a function along with the tangent line defined by its derivative at a point. The slider animates the point at which the derivative is taken and illustrated.